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Hilbert space Z/^(R"). Our approach applies more generally to families of 
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lattice Z" in R". Starting with a non-zero vector tp £Ti, we look for relations 
among the vectors in the cyclic subspace in Ti. generated by ?/). Since these 
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1. Introduction 

The study of frames in Hilbert space serves as an oprator theoretic context for a 
variety of wavelet problems (see e.g., |Dau92j ). and more generally for the study 
of generalized bases in harmonic analysis. Loosely speaking, a frame is generalized 
basis system involving the kind of "over completeness." Since many wavelet con- 
structions do not yield orthogonality, the occurrence of wavelet frames is common. 
In this paper, we will consider various spectral problems in frame and wavelet 
theory in the context of a single unitary operator T in a fixed Hilbert space 7i, 
or more generally a finite commuting family of unitaty operators. This of course 
is equivalent with the consideration of a unitary representation of the group Z of 
all integers, or of 1^ in the Hilbert space 7i. Since every such representation is 
unitarily equivalent to a representation by multiplication. We will take advantage 
of this fact, and account for over completeness in terms of spectrum in the sense 
of spectral multiplicity for unitary operators, see e.g., |Hel641 lHel86 . For general 
facts on operators in Hilbert space, the reader may refer to e.g., [ConQO] . 

An arbitrary infinite configuration of vectors {fk)kez in a Hilbert space Ti 
can be quite complicated, and it will be difhcult to make sense of finite and infinite 
linear combinations J^kez'^kfk- However, in applications, a particular system of 
vectors fk may often be analyzed with the use of a single unitary operator U in 
TC. This happens if there is a fixed vector ip Q TC such that fk = U^ip for all fc e Z. 
When this is possible, the spectral theorem will then apply to this unitary operator. 
A key idea in our paper is to identify a spectral density function computed directly 
from the pair (</?, U). 

Hence the study of linear expressions J^k'^kfk may be done with the aid of the 
spectral function for this pair {if, U). A spectral function for a unitary operator U is 
really a system of functions (p^), one for each cyclic subspace TL{ip). In each cyclic 
subspace, the function p^p is a complete unitary invariant for U restricted to TL{p): 
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by this we mean that the function p^p encodes all the spectral data coming from 
the vectors fk — U^Lp, k £ Z. For background literatu re on the s pectral function 
and its appUcations we refer to pTOSl [JP051 ILWW041 |PSWX03[ ISad06[ ITTOT] . 



In summary, the spectral representation theorem is the assertion that com- 
muting unitary operators in Hilbert space may be represented as multiplication 
operators in an L^-Hilbert space. The understanding is that this representation is 
defined as a unitary equivalence, and that the L^-Hilbert space to be used allows 
arbitrary measures, and L^ will be a Hilbert space of vector valued functions, see 
e.g., [H^Sfi] . 

The term "frame" refers to a generalized basis system involving the kind of 
"over completeness" that arises in signal processing problems with redundancy, 
see e.g., |BCHL06l ICKS06] and [ChrOB] . It is our aim here to account for this kind 
of over completeness via representation by operators and vectors arising from an 
appropriately chosen spectral representation. 

While our theorems apply to the general case of the spectral function for a 
finite family of commuting operators in Hilbert space, our motivation is from the 
case of wavelet operators in the Hilbert spaces L^(M) and i^(M'*). Hence section 
[3] begins with function theory. The general and axiomatic setting is introduced 
in sect 3, which also contains the main technical lemmas. The remaining of our 
paper deals with applications, and they are divided into three parts: operator 
theory, frame theory and wavelet resolution spaces (sect [5|) , and finally stochastic 
integration (sect [8]). But our recurrent theme is the spectral function. 

Notation. We will be using Z for the group of integers, E for the real numbers, 
C for the complexes, and T for the circle, or equivalently the one-torus, T = 
{z e C||z| = 1}. The terminology ^^(K), or L'^{W) will refer to the usual L"^- 
spaces defined from Lebesgue measure. We will have occasion to consider other 
measures as well, but it will be understood that they are Borel measures. They 
may be singular or not. The terminology "absolutely continuous" will refer to the 
comparison with Lebesgue measure in the appropriate context. 

To see the connection to spectral multiplicity for unitary operators, consider 
the unitary operator T in the Hilbert space H :— L^(R) of translation by 1, 
i.e., {Tf){x) :— f{x — 1). In this case, this unitary operator T is represented 
by multiplication via the Fourier transform W, where we view W as a unitary 
operator, W : L'^(M) -^ L^(]R). But we shall be interested in localizing the analysis 
of T, so in considering the action of T on a single vector tp in L'^(R), or on a finite 
family. The action of T on a single vector is determined by a scalar measure, and 
the action on a finite family of vectors by a matrix valued measure, as we outline 
below. 

In order to make a direct connection to the study of closed translation in- 
variant subspaces in L^(M), or L^(IR'*) we begin in section [3] with the case when 
our Hilbert space Ti. is L^(]R), and when the unitary operator T is translation by 
1, i.e., {Tf){x) :— f{x — 1). In that case, of course, the powers of T by /c G Z, 
{T^f)(x) := fix - k) for A: G Z, x G R, and / e L^{M). 
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In the context of over completeness in the Hilbert space Lp' (E) , the question of 
non-trivial infinite linear combinations arises naturally, for example in the study of 
translation invariant subspaces in L^(E), see jDau92] and |Hel64| . In this context, 
we must study infinite sums 'Ylkez^kT^ f of the translates {T^ f){x) := f{x — k) 
for k (£ 1,, when / is a fixed function. Since these translates are not assumed to be 
orthogonal, one must be careful in the consideration of such infinite combinations. 
For example should the coefficients Cfe, A: e Z, be chosen from P7 Or from what 
sequence space? 

The question of infinite linear dependencies of translates arises in Kolmogorov's 
and Wiener's prediction theory (see e.g., [MS80J ) . and it is referred to there as L^- 
independence vs L^-dependence. This framework will be naturally included in our 
considerations below. However, we will begin with L^(R)-considcrations. 

As it turns out, our approach applies more generally to families of n arbitrary 
commuting unitary operators in a complex Hilbert space Ti, or equivalently to the 
spectral theory of a unitary representation U of the rank-n lattice Z" in M". 
Starting with a non-zero vector -0 in 7i, we look for relations among the vectors 
in the cyclic subspace 7i('0) in TC generated by ip. Since these vectors 

{C/(fc)V'|fc e Z"} 

involve infinite "linear combinations," the problem arises of giving geometric char- 
acterizations of these non-trivial linear relations. 

This is the setup in section [4] below. Our study of the cyclic subspace H(V') 
is done with the aid of an associated spectral measure fi = fi^f,, and we begin 
in section [5] by introducing an isometric isomorphism from L^ (/i) onto the cyclic 
subspace Hi^p). 

In the multivarable case, we must make use of funcion theory on the n-torus 
T", and the reader is referred to [Rud69[ lRud86| for that. 



2. A Lemma 

In wavelet theory, there are natural choices of Hilbert spaces and of generating 
functions. For each such choice, one wishes to consider linear combinations for the 
purpose of decomposing general vectors. For this to be successful it helps that the 
vectors fk have the following representation as outlined in Introduction: with the 
use of a single unitary operator U in Ti, if there is a fixed vector (p G Ti such that 
fk = U'^cp for all fc e Z. 

The following lemma gives a necessary and sufficient condition for this to 
work. The crux is two versions of stationarity. 

Lemma 2.1. Let Ti. be a Hilbert space, and let {/fejfcez C 7Y \ {0} be given. Then 
the following two conditions are equivalent: 

(i) {fj+n\fk+n)H = {f]\fk)n, for allj,k,n,e Z; and 
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(ii) There is a Gaussian probability space {Q, P), and a stationary stochastic pro- 
cess {Xk)k£Z, i-e., each Xk : Q —f C a random variable, and an isometry 
W -.n^ L'^{n,P) such that Wfk = Xk for all k e Z, and 



{fj\fk)n = E{X,Xk) = / X,{uj)Xk{uj)dP{u;). 

Proof. For every n e N, consider the usual Gaussian density in C^"+^, i.e., z — 
(z^n, ■ ■ ■ , z:q, zi,- ■ ■ , z„) with mean En{zj) — and covariance 

EniTjZk) = {fj\fk)H , -n<j,k< n. 

It is easy to see that this is a Kolgomorov consistent system |Jor06a[ INel69| . The 
existence of the infinite Gaussian space (f2, P) with the desired properties now 
follows. In particular f2 is a space of function w : Z ^ C, and Xki^uj) — uj{k), 
k<El. D 

Remark 2.2. In section [5] we will be using an analogous family of Gaussian Hilbert 
spaces, and the associated spectral density functions. 



3. Notation and Statement of the Problem 

Preliminaries 

While we will be stating our main results in the general context of unitary operators 
in Hilbert space (section 2] below), and stochastic processes (section |S]), it is helpful 
to first consider a prime example illustrating the kind of interplay between function 
theory and Hilbert space geometry. Such an example is afforded by the case of the 
unit-translation operator in the Hilbert space I/^(K), and we begin with this below. 

We will study the interconnection between L^ (IR)-functions and their restric- 
tions to unit intervals /„ = [n, n -I- 1) for n £ Z. Since the individual intervals /„ 
arise from Iq = [0, 1) by integer translation, it will be convenient to compare the 
two Hilbert spaces L^(0, 1) and L'^{R). 

The L^-norm on R may be decomposed as 

r rn+l pi 

/ \i^{x)\^dx = Y^ / \'ip{x)\^dx^ / ^\i}j{x + n)\^dx. 

So if we introduce Ptp{x) :— J2nez \'4'{x + n)\'^ = PERj-^p, then p^ e -^^(0, 1), and 

J^p,p{x)dx = /jj \tP{x)\^dx = ||V'lli2(R) 

We will study what properties of a given L^ (M)-function tp can be predicted 
from the local p-version. The problem is intriguing, since the fixed function p G 
L^(0, 1) may be decomposed in many different ways as p{x) = PER|-0(a;)p with 

ip e L^{R). 

We will study the initial function p via L^ (/i) where 



d^{x) = p{x)dx. (3.1) 
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In fact, we will study L^{fJ.) even if the measure /i is not assumed to be absolutely 
continuous with respect to Lesbegue measure. But in the absolutely continuous 
case, the function p will pop up as a Radon-Nikodym derivative. 

Moreover, we will need the following matrix version of (|3.ip . Let iV be a 
positive integer and let AI^ denote the complex N x N matrices P satisfying 
spec{P) C [0, cx)). 

Definition 3.1. We say that a measurable function [0, 1)9x1-^ P{^) G ^^^v i^ ^^ 
if for all vectors v G C^ the functions x -^ {v\P{x)v) is in £^(0, 1) 

Notation. For v,w £ C^ , we set 

N 

{v\w) := y^tJ^Wfc. 

k=l 

If n is any Borel measure supported on a subset of R, and f,gEL^ (/i) , we set 



Let JF c L^(IR) be a finite subset of N elements. We then define a function 
P = Pjr: [0, 1] -. M+ 
as follows. Let J-' index the rows and the columns in P via (Pip,,/,) ip,'il' (z J-, where 



iPv.4') = PER((^(a;)V'(x)). 

An easy calculation shows that P is L^, and that 
1 

P^,^{x)dx = (',5|?/')l2(k), for all ip,i> e J^. 



Lemma 3.2. Let P : [0, 1] -^ M^ be given and suppose that x k-> |lP(a::)|l2,2 G L°° 
then for all v G C^ , we have the estimate 

\\Pix)vf < \{v\P{x)v) 

where A := sup\\P{x)\\2.2 

X 

Proof. Since ||P(x)u|p — {v\P{x)'^v), the assertion is a statement about a single 
P G A/j^ refering now to the usual ordering on the Hermitian matrices. Let P = 
"^XiEi be the spectral resolution with (Ei) denoting orthogonal projections, i.e., 
EjEk = S.j,kEj. Then 

P^ =Y^ \^jE.j < niaxAfe ^ XjE^ = (maxAfe) P. 

3 3 

The result is immediate from this. D 
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Definition 3.3. We shall use the following notation e^, fc e Z for the Fourier basis 
in £2 (0,1): 

efe(x) = e^2.fe.^ xe[0,l]. 
With this convention, the Parseval identity in L^{0, 1) reads, 

2 



E 

fcez 



Ck\ 



J2(^kek{x) 



feez 



dx, for aUc= (cfe) e ^^(Z). 



(3.2) 



Definition 3.4. Let fj, he a positive Borel measure supported in the unit-interval 
[0, 1] C M. Assume ^([0, 1]) < oo. Let T> C ^^(Z) of all finite sequence {ck)kez', i- 
e., Ck = for all but a finite set of index values of k. We define a linear operator 
F -.V^ L'^in) as follows: 



F((cfe)) := y^Cfcefc(x). 



(3.3) 



Lemma 3.5. // 



E 



ek{x)dfi{x] 



< oo. 



(3.4) 



then the operator F is closable. 



Proof. An operator is said to be closable if the closure of its graph (c, Fcjcev is 
again a graph of a linear operator. In that case, we say that the resulting operator 
is the closure of F. It is known that to test closability we only need to check that 
the domain of the adjoint operator F* is dense. The formula for F* is as follows: 



{F*f\c)i2 = (/|Fc)i2(^), / e dom(F*), c e V. 



It follows that 



iF*f), 



ek{x) f {x)d^{x) 



Hence, p.4p is simply saying that the Fourier functions Ck belong to dom(F*). 
Since the span of the functions e^ is dense in L^(fi), we conclude that F is closable. 

D 



We shall also need the following fundamental result from operator theory: 



Corollary 3.6. Suppose ^3.4^ 1 is satisfied, denote the closure of the operator F by 
the same symbol. Then F* F is selfadjoint operator, and there is a partial isometry 
U such that F = U{F*Ff/'^ = {FF*Y/'^U. The partial isometry U will be chosen 
with initial space equal to P Q ker{F) and final space equal to the closure of the 
range of F. 
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4. Unitary Operators 

Let 7i be a (complex) Hilbert space and let (Ti, ..., Tn) be a finite family of com- 
muting unitary operators in Ti. Wc introduce the following multi-index notation 
k = (fci, ..., kn) E Z", i.e., kj E Z for I < j < n, and 

For vectors ip eH\ {0}, we set 

iJk := rV, kEZ'' (4.2) 

The closed subspace in H generated by the vectors {ipklk E 1f^} will be 
denoted Tiiip)] and it is called the cyclic subspace generated by the vector -0. 

For points z — (zi, Z2, ..., Zn) E T", we shall be using the [0, 1) x • • • x [0, 1) = 



[0, 1)" parametrization 
and identifications: 



Z < > {kiXi, k2X2, ..., knXn) if fc G Z"; 

and 

ZW < > [Xi +yi,X2 +y2,-;Xn +Vn) (4.4) 

where the addition in the coordinates in (|4.4p are addition mod 1, i.e., addition in 
the group R/Z. Hence T" ~ M"/Z". 

Our present approach to the Spectral Representation Theorem for families 
of commuting unitary operators in Hilbert space is closest to that of [Nel69| . 
a set of Lecture Notes by Ed Nelson; now out of print but available on URL 
|http://www. math. princeton.edu~ nelson/. The multiplicity function is presented 
there as a complete invariant. Of course, in wavelet applications, there are also the 
additional consistency relations (see [BMM99] '). but the notion of a multiplicity 
function is general. 

This representation theoretic approach, adapted below to our present appli- 
cations, fits best with how we use the Spectral Representation Theorem in un- 
derstanding wavelets and generalized multiresolution analysis (GMRAs); see also 
|BagOO| IBJMPOSi IBMM99J . The standard presentation of the Spectral Theorem 
in textbooks is typically different from the Spectral Representation Theorem, and 
here we spell out the connection; developing here a computational approach. 

Lemma 4.1. Let Ti, T — (Ti, ...,Tn) and ip be as described above, and let 'H{ip) be 
the cyclic subspace in Ti generated by {ipk\k E Z"}. Then there is a unique Borel 
measure fj, on [0,1]" and an isometric isomorphism 

W■.L\[0,l^,^,)^n{i;) (4.5) 

determined by 



feeZ" fee 



^ Ckz- ^ 2^ CkT^^ (4.6) 
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on the trigonometric polynomials. 

Remark 4.2. The significant part of the lemma relates to the Spectral Theorem: 
It is the extension of the mapping in (|4.6|) from the trigonometric polynomials to 
the algebra of the measurable functions. 

Proof, (of Lemma HtJ We first elaborate the formula ()4.6|) . Set 

z'' : = ek{x) 

i2-jrk-ixi i2'jrk2X2 i2-jrknXn 

i2-Kk-x 

with k ■ X := kixi + • • • + knXn, and for finite summations: 

^Cfez'= = ^Cfeefe(a;). (4.7) 

feez fcez 

This is the representation of the trigonometric polynomials as Z"-periodic func- 
tions. Set 

mdx) := ^ CkCkix) 

fceZ" 
and 

m,{T)il; := ^ CkT'^^/j. (4.8) 

fcGZ" 

By the Spectral Theorem, this is a projection valued measure on [0, 1]" such that 



mc{T) = / mc{x)E{dx). (4.9) 

The measure E is defined on the Borel sets S„ in [0, 1]": 

E:Bn^ PROJ(H) 

and 

E{Ai n A2) = E{Ai)E{A2), for all Ai, ^2 € Bn- (4.10) 

A linear operator E : H ^ H is said to be a projection if and only \i E = E* = 
E"^ . Note that condition (|4.10p for a projection valued measure implies that for 
Ai n A2 = 0, the subpsaces E{Ai)Ti and E{A2)H are orthogonal. The measure 
fi — fj,^ in the conclusion in the lemma is 

^,iA) : = \\EiA)^r 

= {ij\E{A)i;)n. 
Since 

Z" 9 fc K^ U{k) : = T'^ 

— -'l -'2 ' ' ' ^n 

is a unitary representation, there is a projection valued measure 
6(T") 9 A K^ £:(yl) e PROJ(H) 
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such that 



In = j E{dx), and 



U{k) = / ekix)E{dx), for all yfc e Z". 

This means that for every measurable function m : T" ^ C, the operator ni(T) 
may be defined by the functional calculus 



m{T) = / m{x)E{dx). (4.11) 

Setting /i = ^^ we conclude that /i is a scalar Borel measure, i.e., 

^i^iA) : = (V|i?(A)V)w (4.12) 

= mAmn (4.13) 

We have used that 

E{A) = £;(A)* ^ E{Af, for aU A e 6(T"). (4.14) 

Lemma 4.3. Let Q : Ti. ^ Ti. be a linear operator. Then the following are equivalent: 

(a) QU{k) = U{k)Q, for all k e Z"; and 

(b) QE{A) ^ E{A)Q, for all A e 6(T"). 

In summary, a bounded operator Q commutes with the unitary representation U 
if and only if it commutes with the spectral projections. 

Proof. Left to the reader. D 

We are now ready to define the isometry W — W^ from (|4.5p . where 

W^:L''{T\tx^)^n{iP). (4.15) 

Set 

W^{m) -.^ m{T)i) (4.16) 

with m a measurable function on T", and with m{T) defined by the measurable 
functional calculus in (14. lip . 
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The verification of the isometric property for Wjj, is as follows: 

2 

m(x)E{dx)^ 

H 

m{x)E{dx)tl;\ / m{y)E{dy)%l:)u 



jn{x)m{y){E{dx)ip\E{dy)'ip)-H 



^^ m{x)m{y){^p\E{dx)E{dy)ip)n 

bty ]4.10ll Jt" 

bt< i4.12l i Jt" 

= II"i||l2(T",^^)- 

While the calculation is done initially for m E L°°{ii^), after the isometric property 

\\m{T)M\n = \\m\\LH^^) (4.17) 

is verified, it follows that 

W^{m) ■.^m{T)%l) 
is now well defined for all vi G L'^{^^); and the operator VF^ resulting by L^-norm 
completion will be defined on all of L'^{^^). 
To show that 

w^L^{^i^)^n{iJ) (4.18) 

we check that if ^ G 'Hi'ip), and 

{^\m{T)i;)n = 0, for aU m G L^i^^4,), (4.19) 

then ^ = 0. 

First note that for A G S(T") we have 

mEiAm^<urt,4A). 

Hence, by the Radon-Nikodym Theorem, there is a function F^ G L^{fi^) such 
that 

{^\E{dx)^) = F^{x)dfi^{x), 
and 

m{x)F^{x)d^i^{x) ^ (4.20) 



IT 

for all functions m as above. 
As a result, 

^^F^{T)^. (4.21) 
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But since (|4.20p holds for all m, we conclude that F^ = 0, ^^ a. e. 

Substituting back into (|4.2ip . we conclude that ^ — 0. But VF^ is isometric, so 
its range is closed. Since it is dense, the desired conclusion (|4.18p now follows. D 

We now turn to the case of matrix-value measures. The setting is as above: 
T = (Ti,...,T„) a given set of commuting unitary operators acting in a Hilbert 
space TC, i.e., 

Tj-.n^n, l<j< n. (4.22) 

The main difference is that we will be considering cyclic subspaces in Ti. generated 
by a fixed finite family J^ = {^/ii, '02, •■■, V'Jv} in H \ {0}. We let HiJ-) denote the 
closed span of the vectors 

{TVjIfc e Z", 1 < j < n}. (4.23) 

Let 

6(T") 3A^ E{A) G PROJ(H) 
be the projection valued measure introduced in (|4.1ip . i.e., satisfying 

T'' = I z^E{dz), (4.24) 

or in additive notation 



T"" = / ek{x)E{dx). (4.25) 

Setting 

PrAA) := {ipr\E{A)%lj,), for 1 < r,s < iV, AeB, (4.26) 

we note that P{-) is a matrix-valued measure on T", i.e., taking values M^. 
Specifically, let v e C^, and A £ K(T"). Setting tp := X]r=i ^ri^r, we get: 

{v\P{A)v)i-2^ ^Y.J2^r{A\^{A)^P,)v, 

r s 

= (^Vr-4^r\E{A)^Vstps)n 
r s 

= \\E{A)n^^ > 0, 

as claimed. 

Definition 4.4. Let P be the matrix- valued measure defined on S(T") as in (|4.26p . 
The Hilbert space L'^{P) then consists of all measurable functions m : T" ^ C^ 
such that 



\l 



^ / {m\P{dx)m)i2 < oo (4.27) 

where rri^ = (toi, ..., tti^v), and 

{m\P{dx)m)i2^ ■.^^^mr{x)Pr,s{dx)ms{x). (4.28) 
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Lemma 4.5. LetTi, T = (Ti, ..., r„) andJ- = {i/'ij "02 7 •■•j V'-Zv} ^^ 'J-s described above. 
Let P = Pjr &e </ie corresponding matrix-value measure, and let Ti.{J-') denote the 
(closed) cyclic subspace in Ti generated by {T^ip\k £ Z",-!/) G JF}. For m G L^{P), 
set 

N 

W{m) := ^TO,.(r)7/'r. (4.29) 

r=l 

Then W defines an isometric isomorphism 

mapping L'^{P) onto Ti.. 

Proof. Except for technical modification, the proof of the lemma follows the idea 
in the proof of Lemma |4?T1 which is the special case of TV = 1. 

Hence we restrict our present discussion to the verification that W is isometric 
from L2(P) intoH. 

For m in L?[P)^ set rn^ := (TOi,...,mr)j the scalar coordinate functions. 
Then 



\\Wm\ 



H 



N 
"y \mr{T)%l:r 


z 


r=l 


H 

..9 


N 
> ; / mr{x)E{dx)i>r 




r^l-'T" 


H 


N N „ 


r=ls=l"'^ 


{x)PrAdl 


•)m,s{x) 



{m\P{dx)m) 



T" 



The arguments from Lemma |4 . 1 1 shows that W in fact maps onto T-i{J-). 



a 



5. Corollaries and Applications 

In this section we return to the main application of the general spectral theory 
developed in section [4] 

While the setting in section 2] applies, in the single variable case, to a general 
unitary operator T in Hilbert space Ti; and in the multivariable case to a finite 
commuting family (Ti,T2, ...,Tn) of unitary operators, the main application is to 
n = L^iR), OT to n = L^R"). 

In the single variable case, the unitary operator T will be translation by 1 to 
the right of functions on the real line M; and in the multivariable case, the system 
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will consist of these translation operators but now referring to unit-translation in 
the n coordinate directions. 

Our first Corollary of the general formulas for the spectral measure/function 
in section [4] will show that, in the translation case, the spectral measure /i is 
absolutely continuous with respect to Lebesgue measure, and that the Radon- 
Nikodym derivative is the function introduced above in section [3l 

While the results apply to the general multivariable setting, for clarity we 
will only give full details in the single variable case. But with the aid of section [3l 
the reader will be able to extend the formulas from n = 1 to n > 1. 

We stress that there is a spectral measure n = n^ for every vector in the 
Hilbert space. But this section is concerned with the Hilbert spaces H = L^(IR"). 
And so the spectral measure ^ — fi^^ depends on which function ip is chosen in 

n = l2(r"). 

Corollary 5.1. Let {Tf){x) :— f{x — 1) be the translation in L^(IR), and let 

m := / e-^^-'-^f{x)dx (5.1) 



be the L^ -Fourier transform. Let ip g L^(IR) \ {0}, and let fi :— fi^ be the spectral 
measure introduced in Lemma\4-.1\ Then 



(i) /i is absolutely continuous with respect to Lebesgue measure dt on [0, 1]; 
(ii) The Radon- Nikodym derivative is as follows 

^ = Y.\^[t + n)\^ ^ PER\i.\\t); (5.2) 

nGZ 

and, in particular, 
(iii) PER\i}\'^ is mLi(0,l). 

Proof. Recall the functional calculus defined for the Borel functions m on [0, 1) ~ 
K/Z introduced in Lemma 14.51 by extending the following formula 

p(z) = ^Cfcz'=K^^Cfcr'= (5.3) 

k k 

defined initially on the polynomials where the following notation and identification 
is used: p{t) :=p(e*^'^*), and 

{T^ f){x) ^T o ■ ■ ■ oT J{x) = J{x - k) forxeR, and fc e Z. 

k times 

If m is a Borel function on [0, 1) we let rn{T) denote the Borel functional 
calculus which arises from the extension of (|5.3p via Lemma [4. II If A e S([0, 1]), 
we will use this for the function m := xa- In particular, xa will automatically be 
extended from [0, 1] to M by periodicity. 
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As a result 

P'ER{\^P\^)dt ^ I XA(t)PER|i/;p(t)dt 

XAit)\m\'dt 



= WxAiTW 
= /i,0(A). 

This proves that d/i^ is absolutely continuous with respect to dt on [0,1], and 
that the formula (15. 2|) holds for the Radon-Nikodym derivative -^. Since -^ ^ 



L^(0, 1) by the Radon-Nikodym theorem, we conclude that the almost everywhere 
defined function PER|-0P is well defined, and in L^(0, 1). D 

We now turn to several generalizations, including the niultivariable case, and 
some cases of unitary operators T different from the translation operator in L^ (M) . 
There is an additional question which is motivated by applications, and which we 
will answer concern conditions for when the Radon-Nikodym derivative of the 
spectral measure /^ = /^^ is in L^, and in L°°. 

We now turn to a variety of structural properties that may hold for a bilat- 
eral sequence of vectors obtained by the application of powers of a single unitary 
operator to a fixed non-zero vector ^ in a Hilbert space. These are conditions 
which arise in harmonic analysis [Chr03| , in wavelets |BMM99l |BagOO[ IBJMP05] , 
and in signal processing [CKS06], and they are denoted by the name "frame." But 
there is a host of distinct frame conditions, and our next result shows that they 
are determined by specific properties of our associated measure /i^ . 

In addition, we show that under certain conditions, the vector -0 may be 
replaced by a renormalized version which has the effect of turning the spectral 
Radon-Nikodym derivative into the indicator function for a certain Borel set. 

Definition 5.2. Let T : H ^ H he a unitary operator, and let ip £ T-C\ {0}. For 
fc e Z, set 

i^k := TV- (5.4) 

Let Ti^ip) be the cyclic subspace generated by ip^ i.e., the closed space of the family 
{V'fc|fe & Z}; see Lemma |4?T] 

We shall be concerned with the following properties for the sequence of vectors 
ipk, fc G Z: 

• ONB: 

{ilj]\^k)n = Sj,k, for all j, k £ Z; (5.5) 

i.e., {V'j} is an orthonormal basis in Ti.{ip). 

• Parseval: 

El(^.'-|/)l' = 11/11?^' foi-all7^(V); (5.6) 

i.e., {ipj} is a Parseval frame in TL{ip). 
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• Bessel: 

There exists B £ R+ such that 



EK^^I/)I'^^II/II«' for all / e H(^); 



(5.7) 



jei 



i.e., {ipj} is a Bessel frame in 'H{ip). 

Frame: 

There exists A.B eR+, A < B < oo such that 



^11/11^ < E K^j-i/)i' ^ ^ii/iiw' for ^11 / ^ ^(^); 



(5.8) 



jGi 



i.e., {V'j} is a frame in 7i(V'). 

Riesz: There exists A,Bg M+, A < _B < oo such that 

2 



^Ikll 



< 



fcez 



Cklpk 



<B|lc|1^2, for aUc= {cj) £ l'^{Z); 



(5.9) 



H 



i.e., {V'j} is a Riesz basis (with bounds {A,B)) for Ti.{ip). A part of the 
definition is the convergence of J2k£Z '^k4'k in Ti-. 
• Absolute Continuity: We say that the measure ^^ is absolutely continuous if 
Radon-Nikodym derivative 



^=P,.L'(0,1) 



(5.10) 



exists, where by dx, we mean the restriction to [0, 1] of Lebesgue measure. It 
will be convenient to use the isometric isomorphism L^(0, 1) -^ L^(T) defined 
by: f{x) < — > F{ei{x)) where ei{x) := e'^'^^. 

The next result yields a gradation of the conditions in Definition 15.21 In its 
statement we will make use of the notation esssupp for essential support, and 
esssup for essential supremum. The abbreviation a.e. will be for almost every. 



Theorem 5.3. We have the following implications: \5.T\j Bessel =^ i5.1(^) Absolute 
Continuity =^ Renormalization. 

By the last condition (renormalizaton) we mean this: There is a vector iJjren G 
Ti, and a Borel subset A C [0, 1] such that the following three conditions (a) - (c) 
hold: 

(a) 'H(V') = T-COjren), and 

(b) dn^^^^ix) = XA{x)dx, and 

(c) A = ess suppip^). 



Proof. Assume (I5.7p . Let / e 7i(V') have the form / — m[T)%l), see (|4.17p . as in 
the proof of Lemma HTT] We then have 

2 



E 

feez 



\{^k\f)?^Y. I 



ek{x)m{x)d^i^{x) 



(5.11) 
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Using (|5.7[) . we conclude that the Fourier coefficients of the measure m{x)dfi^{x) 
are in PCZ). Since this holds for all m, it follows that d/i^ has the form 

d^j.^{x) — p^{x)dx (5.12) 

where p^ G L"'^(0, 1) is the Radon-Nikodym derivative. This is condition (|5.10p 
which was asserted. 

Now substituting back into (|5.11|) and (|5.7|) . we get 
1 pi 



\m{x)p^{x)\ dx < B \m{x)\ p,p{x)dx (5.13) 

Rewriting this as 



1 j-i 



'pi^mj p^{x)dx < -B / |to| p^dx 
Jo 

we see that (|5.7p is equivalent to the boundedness of the following multiplication 
operator 

Q^:m\ — > ^/p^m (5.14) 

in the Hilbert space i^([0, l],p^dx), i.e., to estimate 

WQi'Mlhip^) < 5|l"i|li2(p^), for aU TO. (5.15) 

Hence the function p^p is essentially bounded (relative to Lebesgue measure) , 
and esssup(p^) = ||p^||oo < B. Let A — A.^ :— esssupp(p^) — the essential support 
of p^i, . Then the identities 

P^XA=P^ (5.16) 

and 

Pi>X[n.i\\A = (5.17) 

hold almost everywhere on [0, 1]. 
Using Lemma [4.11 and setting 

^x) -.^ XA^{x)p^{x)-^'\ (5.18) 

we note that the functional calculus applied to T yields a vector 

V'REN := e(7^)V' (5.19) 

well defined in 7i. 

We now apply the functional calculus of T to the modified vector, i.e., to 
V'REN, and by Lemma |4T1 we conclude that 

||to(T)V'ren||?, = \\mi{T)nn 

r-l 

\m^\'^p^dx 



bv \A.n\ Jn 

\rn\ dx. 



bv ib.lGl J A 

holds for all m. Conclusions (b) and (c) now follow. Conclusion (a) amounts to a 
third application of Lemma |4. II to V'ren- D 
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Some of the conclusions in the next coroUary are folklore, but we include 
them for completeness. Moreover, they arise as special cases of our more general 
theorems. 

Corollary 5.4. Let T : TL ^ TL he a unitary operator, and let tp € Ti.\ {0} be given. 
Suppose the measure fi^ is absolutely continuous, and let dfj,^{x) — p^{x)dx with 
Pip denoting the Radon-Nikodym derivative. 

Then for the five frame properties in definition \5.S\ concerning the subspace 
Ti.{4') we have the following characterizations: 

• ONB Ii5.5]) : p^p = 1, i.e., Pti,{x) = 1 for almost every x G [0, 1]. 

• Parseval 115.6]) : There exists S G S([0, 1]), \S\ > (referring to Lebesgue 
measure) such that p^{x) — Xs{^)j ^ € [0, 1]. 

• Bessel (5J^: p,p G L°°(0, 1) and \\p^\\oo < B. 

• Frame (A, B) i5.8\) : The estimate A < p^ < B a.e. on esssupp (p^), i.e., 
holds on esssupp{p,p) where esssupp stands for the essential support of x ^ 
Ptp{x) on [0, 1]. 

• Riesz \5.9jl : The estimate A < p^ < B holds for almost every x G [0, 1]. 



Remark 5.5. So the distinction between the two conditions ()5.8p and (|5.8|) is the 
question of whether the pointwise estimates are assumed only on the essential 
support, or everywhere; of course excepting Lebesgue measure 0. 

Proof. The details of proofs are contained in the previous discussion except for 
the necessity of the condition stated in ()5.6|) above. 

Suppose the Parseval indentity (|5.6p holds on 7i('0). Substituting / — m{T)ip 
into (|5.6p we get the following identity 
1 /.I 



|TO(a;)| p,p{x) dx = \m{x)\ p^{x)dx, for all to. 
/o Jo 

As a result p^{x)'^ = p^{x) for almost every x G [0, 1] or p^(x)(p^(x) — 1) = 0, 

almost every x G [0, 1]. Since ip y^ inTC, Lemma 14^1 shows that if 5 = 5,^ denotes 

the essential support of p^, then \S^\ > 0, and 

P-4^{x) = Xs^{x) for almost every x G [0, 1], (5.20) 

as claimed. D 

Corollary 5.6. Let T : TL —t TL he a unitary operator, ip Cz Ti\ {0}, and dfi^,{x) = 
p^{x)dx as above. We assume that p-^, G L°°(0, 1) with Bessel bound B{< oo). 

Then the infinite series X^/cgz CfcV'fc 's well defined and norm- convergent in 
H for all c = {ck)kez S Z^(Z). Moreover, 

y^ CfeVfc = 0, for some cG P\ (0) (5-21) 

fcez 
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if and only if there is a 

E e S([0, 1]) such that \E\ > 0, and p^ ^ on E. 
Proof. For c G P, set mdx) — J^kez'^kEkix). Then 

/ \mc{x)\'^dx = y^lcfcp; 



(5.22) 



(5.23) 



in particular nic G ^^(0, 1). 

By Corollary 15.41 functional calculus and Lemma [4.11 the vector mc{T)tp is 
then well defined for all c E P: and 



\\mc{TWn 



y^cfcV^fc 



kei 
1 



« 



|mc(a;)pp^(a;)dx 



< B \mc{x)\'^dx 
u KTi Jo 



Hence 



lim 



= SVlcfel 



/cG( — oo, — m)U(n,C3o) 



W 



proving the first assertion. 

Now suppose ce P\{0), and ([OT|) holds. Then 



|TOc(a;)|^p^(a;)rfa; = 0. 



If Ec := esssupp|mc(a;)p, then \Ec\ > 0, and p^p — almost everywhere on Ec- 
This is the desired assertion (I5.22p . 

Conversely, suppose ()5.22|) holds for some set E e B{[0, 1]), i.e., that \E\ > 0, 
and p^ = on E. Then, by (|5.23p applied to xe, we get the L^{0, l)-expansion 
Xe{x) = J2kez^kekix) almost everywhere on [0, 1], \E\ = HxsW h = Y^kai l^/cP > 
0. Hence X^feez '^ki'k = in W, and c 7^ in /^. This is (I5.21|l . and the proof is 



completed. 



D 



Remark 5.7. The equivalence of the two assertions (|5.21[) and (|5.22p in Corollary 
5.61 above was conjectured in a talk in Chicago by Guido Weiss in the special case 
when the Hilbert space is L^(R) and when the unitary operator T is translation 
byl. 
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Moreover, in this case, if tp is the given non-zero L^ (R)-function and if (|5.21[) 
holds for some non-zero c in the sequence space P, then we say that the integral 
translates of i/j satisfy an L^-dependency. 

Since there is typically a substantial amount of redundancy in the represen- 
tation in L^(R) of the sequence of translates i/jk , for fc G Z, this notion of i^-linear 
dependency, is more subtle than the familiar notion of linear dependency (involv- 
ing only finite sums) from linear algebra. It was introduced by Kolmogorov, and 
it is used in prediction theory, see e.g., [MS80J . 

Corollary 5.8. Let T : Ti ^ Ti. be a unitary operator, ip d T-l\ {0}, and suppose 
there is some set S G S([0, 1]) such that 

< IS*! < 1, and (5.24) 

Pi:{x) ^ Xsix), for all e[0,l]. (5.25) 

Then there is some c ^ P\ (0) such that '^i-p^CkT'^ip = 0, i.e., there is a non- 
trivial linear relation in TL{ip). 

Proof. Note that (|5:M)) (|05l) and CoroUaryEHdn;!]) imply that the vectors {r'=V|fc G 
Z} form a Parseval frame in 7i(V'); and moveover that 

\\m{T)^\\l^^ ( \m{x)\'^dx (5.26) 

Js 

holds for all m E L^{0, 1). Now take m :— xio,i]\Sj and let (cfc) E P \ (0) be the 
corresponding Fourier coefhcients; i.e., 

fcez 
Recall m{x) = Efcez Cfcefc(a;), and ||TO(a;)|||2 = Efc gz l^fe P- 

But then J2kei. '^kT'^i^ = in 7^ by virtue of ((05)) . D 

6. Dyadic Wavelets 

In this section we read off some corollaries regarding the two spectral functions 
that describe dyadic wavelets in L^(R). 

Lemma 6.1. We state the following result for dyadic wavelet functions i.e., 
mo : K/Z ^ C, |mo(i)P + \mo{t + ^)l' = 1, 

where |mo(0)| = 1, the filter toq is assumed to satisfy the low-pass condition, 
passing at t = 0. 

Let ip,Tp E L^(R) be the two functions for a wavelet filter tuq . The consistency 
relation is the following identity which holds for all t: 

Proof |BJMP05j . D 
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Father function Lp 



Mother function ip 



ip{x) = 1 on [0, 1] and in R \ [0, 1] i}{x) = 1 in [0, i), -1 in [i 1), and in M \ [0, 1) 



Given k an odd integer, we now describe the STRETCHED HAAR WAVELET 



sin {Trkt) 
k-^{7rty^ 



pERi^p = MW^r 



Where we use the formula 



^^ = iv-d ) 
\Mt)\' = 

PER|^|2 



k'^TTt)'^ 



feF( 



sin\^) , cos^i^) 



(2k) 



^(¥) 



^(¥) 



^ 1 _ 7r2 



tt"^ CSC? {nt) , t e 



Spectral Density Functions on [0, 1] ~ M/Z 

If fc > 1 then 

1 / sin^Trkt) \2 



PVkV-) - W\ sin(7vt) I Pi'kV-) - -(2W^ sin^(^) + cos^^) > 




Figure 1. Graph of p^^g 
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J* 0.08 




Figure 2. Graph oi p^^ 




Figure 3. Graph oi p^p^ a,nd p^^ 



Hence we have consistency, but the peculiar thing is that in the stretched 
Haar case, we have a Parseval wavelet (i.e., for the system {ipj.k), i-e., ipj^k{x) = 
2^/'^ip{2^x — k), j,k £ Z, built on the interval from to 3, instead of from to 1). 
Specifically, J2j T,k\{^j,k\f)? = II/IP, for all / e L^^R) but there is no Parseval 
property on TCiip) or on 7i(V')- Indeed, from |Jor06a| . Chapter 6 we know that the 
mother function ip generates a Parseval wavelet frame in 7i :~ L^(M), but only if 
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we use both dyadic scaling and Z-translations. However, in the 3-stretched Haar 
case, we don't get Parseval frame systems for Z-translations alone. 

Specifically, if we consider the stretched father and mother functions, by 
themselves, i.e., the functions ^p and "0 individually, then one may ask whether or 
not the system {if{- +n)\n e Z} is Parseval in 'H{(p); or {ip{- +n)\n E Z} in 7i(V'), 
and the answer is 'no' for both. Neither of the two has the Parseval property. Using 
our Corollary, and our computations of the two spectral functions p^ and p^ we 
can only ascertain that the two Z-translation systems have the Bessel property 
with Bessel constant B = I, but neither satisfies the stronger ones of the frame 
properties. 



7. Cyclic Subspaces 

Definition 7.1. Let A be an abelian group (algebra) represented by bounded op- 
erators on a Hilbert space H. A closed subspace /C C 7i is cyclic if there exists 
(f £ IC\ {0} such that [Af] — /C. Here [•] denotes closed linear span. 



Lemma 7.2. Let A be as in definition \7.1\ acting on a given Hilbert space Ti. Then 
there is an indexed family of cyclic vectors (tpj) such that 

n = 0[^^,] (7.1) 

The symbol^ in |7.-?| j indicates orthogonality, i.e., 

[Ap,]L[Apk\ tfj^k. 
Proof. This is a standard appliation of Zorn's lemma, see e.g., [Nel69j D 

Corollary 7.3. Let T : TL -^ TL be a unitary operator, and suppose p^ £ L°° for 
all Tp G Ti. Let M <Z TL be a closed T -invariant subspace. Then there are subsets 
[0, 1] D S*! D 52 D • • • in B{[0, 1]), and vectors ipj G A4 such that p^. = xSj for 
j = 1, 2, • • • , and 

M = ^n{^,) (7.2) 

where the summation in \7.'/3( l indicates orthogonality of the spaces Ti.{tpj) corre- 
sponding to different index values for j . 

Proof. This follows from the Spectral-Theorem applied to the restricted operator 
T\j\4, combined with the previous two corollaries; see also the references |BMM99l 
|BagOO| for special cases of this result. D 
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8. Stochastic Processes 

In the next section we show that our spectral analysis of translations produces a 
particular class of stochastic processes. Hence our results for translations, and more 
generally, for unitary operators T in Hilbert space have a probabilistic significance. 

This is relevant to the way wavelets are used in the processing of signals 
with noise; see |Jor06al rJor06b| and the following papers |JS07[ [Son07j . A popular 
method of spectral analyzing correlations in stochastic components in a signal or 
in an image is to introduce a spectral function, or spectral kernel, and then an asso- 
ciated selfadjoint operator. When this operator is then diagonalized, a substantial 
simplification occurs. The diagonalization goes under the name "Karhunen-Loeve;" 
see pB07 , SonOfj . But for the use of the Karhunen-Loeve transform method, it will 
be significant that the stochastic processes involved be Gaussian. In this section we 
show that there is always such a Gaussian choice, and that it is canonical. More- 
over we show (Corollary 18. 4p that each of these Gaussian processes is naturally 
associated with a unitary operator so our results from sections |4] and [5] apply. 

A stochastic process is an indexed system of random variables. By "random 
variables" we mean measurable functions on a probability space (J7, A^, P) where J7 
is a set, A^ is a fixed sigma-algebra of subsets in fJ (events), and P is a probability 
measure, i.e., P{S) is defined for S* € Al. 

We will make the starting assumption that our random variables X , referring 
to {n,M,P), wiU be in L'^{n,M,P), abbreviated L'^{P), i.e., that 



\X{uj)\'dP{uj) = E^{\X{lo)\'') = {X\X)l^p) < (XD. (8.1) 

in 

In the present discussion, the index set for the random variables will be [0, 1] 
or the Borel sets ;B([0, 1]). We will say that a process X is Gaussian if Xt, for 
t e [0, 1], or Xa, for A e B{[0, 1]), is Gaussian. 

Lemma 8.1. (Kolmogorov) Let W he a set and let R : W x W ^ €- he a positive 
(semi)-definite function, i.e., 

'^^CyR{v,w)cnj>0, {v,w) eW xW, (8.2) 

for all finite sequences (cwew), *-e., c„, € C \ (0) for at most a finite subset in W, 
depending on c. 

Then there is a Gaussian stochastic process X,W, {Q,Ai,P) such that 

E(XyX^,) = R{v, w), for all (w, w) e W x W. (8.3) 

Proof See e.g., |Jor06a| or [Nel69j . D 

Example. (Brownian motion.) For s, t G [0, 1], set s At — min{s, t), and 

R{s,t):=sAt. (8.4) 

Then R is positive definite, and the Gaussian process (Xt) with 

E(XsXt) = sAt, and (8.5) 



Optimal Decompositions of Translations of L -functions 25 

E{Xt) = (8.6) 

is called the normalized Brownian motion on [0, 1]. 

Example. (Set-indexed Gaussian.) Let ^ be a finite Borel measure on [0,1]. For 
A,Be B{[Q, 1]), the Borel sets in the unit interval, set 

R{A,B)::^ fi{AnB). (8.7) 

Then R is positive definite, and the Gaussian process {XA)AeB{[o.i]) with 

E(XAXB)^fi{AnB) (8.8) 

and E{Xa) = Q, A,B E B{[Q,1]); is called the /i-Gaussian process. (Note that 
E{-) = Jju -dP, and that P depends on //.) 

Remark 8.2. An easy computation shows that Brownian motion is /i-Gaussian 
with /i := the Lesbegue measure restricted to [0, 1]. 

Lemma 8.3. [Nel69j Let {Xa)a£B(Io,i]) ^6 o, ^-Gaussian process; and let m € 
i^([0, 1], /i). Then the stochastic integral 



f m{t)dXt eL\n,M,P) 
Jo 



(8.9) 



m{t)dX, 



2 



m{t)Yd^jL{t). (8.10) 

LHP) 

Proof. The idea in the proof is to construct the Gaussian probability space (fi, 7W , P) 
as in Lemma [^m The main difference between the two cases is that our stochastic 
processes X is now indexed by Borel sets in contrast to the discrete index used in 
Lemma 12.11 D 



Corollairy 8.4. Let {Xa)ai^B([o,i]) ^^ ^ pi-Gaussian process; and define an operator 
T{ I m{t)dXt):^ I ei{t)m{t)dXt, (8.11) 



then T is unitary. 

Proof. By (|8.10p . it is enough to prove that 

L'^ifi) 3 m[i) ^ ei{t)m{t) £ L^(Ai), (8.12) 

is a unitary operator; but this last fact is obvious. D 

Example. (Non-Gaussian) Let {Tf){x) :— f{x— 1) be translation in L'^(R), and 
\etil)EL^{m.)\{Q}. Set 

dii^(t) -.^ p^(t)dt (8.13) 

with 

p^{t):=Y,\iit + n)\\ te[0,l]; (8.14) 

nez 
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and 



Pi, 



(s, t) := ^ i}{s + n)i){t + n). 



(8.15) 



nGZ 



Set 



Xt{n) := V(i + "), n e Z, t e [0, 1]. (8.16) 

Then each Xt in (X()(gro^i] is a random variable on Z with counting measure, 



and 

E{XsXt) = p.0(s, i), for all s, i e [0, 1] 

Proof. See section |3] above. 



.17) 

D 



Our final result also follows from these considerations and the lemmas in 
sectionHl It is about the special case when function p^,{-) in (I8.14p is in i^([0, 1]). 

Remark 8.5. It is of interest to compare the realization of Xt{n) := 'tjj{t + n) in 
i^(R); see (|8.16p with its Gaussian version in i^(ri^, P^), i.e., with the stochastic 
integral 

»i 

m{t)dXteL\n^,P^), 

and with P^ denoting the Gaussian measure. 
The result is as follows: 

For s,t £ [0,1], set 



Q^{s,t) :=^V^'(s + n)7?'(i + n), 



n& 



and V^'(0 — ft^it)- Then 



1 2 

m{t)dXt 



1 ,.1 



m{s)7n{t)Q'^ {s,t)dsdt. 



Corollary 8.6. Let T, i^(R) a^d ?/> 6e as in Example (N on- Gaussian) above. Set 

^^ := T^^ = ^{. _ fc), fc G Z. (8.18) 

On tfie dense subspace T> <Z P of finitely indexed sequences, set 

i^((cfe)fc6z) :=^cfc^fc. (8.19) 

fc«EZ 

We have the following (a) <f=^ (b) =^ (c), where the three affirmations 
(a)-(c) are as follows: 

(a) p^eL^{0,l), 

(b) Mi^k)) e IH^), and 

(c) P D T) — > 'H{ijj) C L^(M) is a closable operator, when F is defined by Ii8.19\) . 
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Proof. Computing the Fourier coefficients p^{k), k d Z, we find 

1 



Pipik) = / ekit)p4,(t)dt 
Jo 

»i 



nGZ 

2, 



= / ekit)m)\ dt 



iJj{x)iIj{x — k)dx 

by Parscval Jm 

= (V'IV'fc)L2, ke'L, 

which proves (a) <;=4> (b). 

Supposing (a), to prove that i^ is a closable operator, note the formula 



{F*!)k = f fix- k)dx, fc e Z 



for the adjoint operator. So condition (a) is the assertion that each ^j is in the 
domain of F* . Since (V'j)jgz spans a dense subspace in 7i('0) C L^(R), it follows 
that F in (|8.f9p is a closable operator. D 



9. A Connection to Karhunen-Loeve Transforms 

Suppose Xt is a stochastic process indexed by t in a finite interval J, and taking 
values in L^{n,P) for some probability space {n,P). Assume the normalization 
E{Xt) — 0. Suppose the integral kernel E{XtXs) can be diagonalized, i.e., suppose 
that 



E{XtXs)(pk{s)ds = \k^Pk{t) 



with an ONB [ipk] in L'^{J).li E{Xt) = then 






Xt{uj) = 2_^y'>^kVk{t)Zk{oj), w G ri 

k 

where E{ZjZk) — 5j^k, and E{Zk) — 0. The ONB (ipk) is called the KL-hasis with 
respect to the stochastic processes {Xt : t £ I}. 

The Karhunen-Loeve-theorem [Ash90| states that if (Xt) is Gaussian, then 
so are the random variables (Zk). Furthermore, they are -/V(0, 1) i.e., normal with 
mean zero and variance one, so independent and identically distributed. This last 
fact explains the familiar optimality of Karhuncn-Loeve method in transform cod- 
ing. 

The following result illustrates the significance of our spectral density func- 
tions in the analysis of Karhuncn-Loeve transforms. 
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Theorem 9.1. Let {Q, P) by a probability space, J d R an interval (possibly in- 
finite), and let {Xt)teJ be a stochastic process with values in L^{fl,P). Assume 
E{Xt) = for all t d J . Then by the spectral density theorem for unitary operator 
(see Corollary \7. 3^ , the Hilbert space L'^{J) splits as an orthogonal sum 

L\j)^nd(Bnc (9.1) 

(d is for discrete and c is for continuous) such that the following data exists: 

(a) ((/5fc)feeN an ONB in Hd- 

(b) (Zfc)fcgN •' independent random variables. 

(c) EiZ'jZu) = Sj,k, and E{Zk) = 0. 

(d) (Afe)cR>o. 

(e) ^p{-,-) : a Borel measure on M in the first variable, such that 

(i) (y3(A, •) e Tic for A an open subinterval of J, 
and 
(ii) {f{Ai, ■)\ip{A2, ■))l^j) = whenever ^10^2= 0. 

(f) Z{-,-) : a measurable family of random variables such that Z{Ai,-) and 
Z{A2, •) are independent when Ai,A2 G Bj and AiH A2 = 0, 



E{Z{X, ■)Z{X', •)) = S{X - A'), and E{Z{\, ■)) = 0. 

Finally, we get the following Karhunen-Loeve expansions for the L^ {J) -operator 
with integral kernel E{XtXs): 

J2 ^k\^k){Vk\ + f A|^(dA, ■)){ipid\, •)! (9.2) 

ken '' ■^ 

Moreover, the process decomposes thus: 



Xt{uo) = ^ ^kZk{uj)Mt) + I VAZ(A, uj)^{d\, t). (9.3) 
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